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Abstract 

This  paper  proposes  structural  and  parametric  enhancements  in  the  Timed  Influence  Nets  (TINs) 
based  framework  for  modeling  Effects-Based  Operations  (EBO).  The  existing  TIN  framework 
does  not  have  the  capability  to  model  the  impact  of  different  sequences  of  actions.  Thus,  no 
matter  what  the  sequence  of  action  is,  the  final  outcome  remains  the  same.  Furthermore,  it  is 
assumed  that  the  influence  of  an  event  on  another  event  is  stationary,  i.e.,  the  influence  remains 
the  same  throughout  the  campaign.  Both  of  these  constraints  may  turn  out  to  be  unrealistic  in 
many  real  world  situations.  The  enhancements  proposed  in  this  paper  would  overcome  the  above 
two  limitations.  The  proposed  structural  enhancement  would  enable  a  system  modeler  to  model 
the  impacts  of  different  sequences  of  actions  on  the  desired  effect;  while  the  parametric 
enhancements  would  aid  the  mathematical  modeling  of  time-varying  influences.  Together  these 
enhancements  make  it  possible  to  model  the  impact  of  repetitive  actions  in  a  dynamic  uncertain 
situation. 

1.  Introduction 

Decision  making  in  uncertain  complex  situations  has  always  been  a  very  difficult  task.  Access  to 
a  large  amount  of  information  has  further  magnified  the  complexity  of  this  problem.  For  an 
organization,  it  has  become  an  unmanageable  task  to  analyze  enormous  amounts  of  information 
in  a  timely  manner.  Several  efforts  have  been  made  to  model  this  problem  using  the  framework 
of  probabilistic  reasoning  and  inferencing,  commonly  referred  to  as  Bayesian  Networks  [Pearl, 
1987],  Timed  Influence  Nets  (TINs),  one  of  the  instances  of  this  framework,  have  been  used 
experimentally  in  the  area  of  Effects-Based  Operations  (EBOs).  [Wagenhals  and  Levis, 
2002;Wagenhals  et  al.,  2003; Wagenhals  and  Wentz,  2003]  A  TIN  models  the  uncertainties  and 
temporal  constraints  present  in  a  stochastic  domain  from  a  Discrete  Event  System  (DES) 
perspective.  The  purpose  of  building  a  TIN  is  to  form  a  coherent  model  of  the  situation  at  hand 
by  combining  the  knowledge  of  several  subject  matter  experts.  The  resultant  model  is  then  used 
as  an  aid  to  decision  makers  to  help  them  reach  a  final  decision  in  a  rational  manner. 

Despite  their  acceptance  as  a  modeling  tool,  the  assumptions  made  by  TINs  limit  the 
capabilities  of  a  system  modeler  in  terms  of  expressing  real  world  situations.  For  instance,  TINs 
do  not  model  the  impact  of  the  sequence  in  which  actions  are  taken.  Thus,  no  matter  what  the 
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sequence  of  the  actions  is,  the  final  probability  of  achieving  the  desired  effect(s)  remains  same. 
This  behavior  is  because  of  the  underlying  assumption  in  TINs  that  events  are  memoryless,  i.e. 
the  probability  of  occurrence  of  an  event  at  a  particular  time  instant  does  not  depend  upon  its  own 
probabilities  of  occurrence  during  the  previous  time  instants.  As  a  consequence,  the  probability  of 
an  event  depends  only  upon  the  actions  executed  so  far  and  not  on  the  sequence  in  which  these 
actions  are  executed.  This  paper  is  an  attempt  to  overcome  this  limitation  of  TIN. 

Moreover,  the  assumption  made  by  TINs  that  the  influence  of  a  cause  remains  the  same 
once  the  cause  has  occurred  is  found  to  be  unrealistic.  In  reality,  events  happen  and  they 
influence  other  relevant  events.  In  many  cases,  the  intensity  of  their  influences  decays  over  time. 
Thus,  an  event  having  a  very  strong  influence  at  the  time  of  its  occurrence  on  another  event  might 
have  an  insignificant  influence  after  a  certain  period  of  time.  For  example,  a  resolution  passed  by 
the  United  Nations  has  a  very  strong  impact  on  the  concerned  parties  at  the  time  of  its  approval. 
As  the  days  pass,  the  resolution  starts  loosing  its  affect  and  after  a  couple  of  months  it  completely 
looses  its  importance  unless  the  problem  is  solved  or  it  is  backed  up  by  another  resolution  on  the 
same  subject.  That  is,  the  influence  of  an  event  is  time-varying.  Currently,  TIN  lacks  the  ability  to 
model  such  cases.  It  assumes  that  the  causal  strength  of  the  influences  does  not  change  over  time. 
This  paper  extends  the  capabilities  of  TIN  by  proposing  a  way  for  modeling  time-varying 
influences. 

The  rest  of  the  paper  is  organized  as  follows.  Sections  2  and  3  describe  Influence  Nets  and 
Timed  Influence  Nets,  respectively.  Sections  4  and  5  describe  the  limitations  of  TINs  and  the 
proposed  enhancement.  Finally,  Section  6  concludes  the  paper  and  points  towards  the  future 
research  direction. 

2.  Influence  Nets 

Influence  Nets  (INs),  an  instance  of  the  Bayesian  framework,  were  proposed  a  decade  ago  to 
overcome  the  intractability  issues  present  in  BNs.  They  employ  an  approximation  inference 
algorithm,  termed  as  loopy  belief  propagation  [Kschischang  and  Frey,  1998;McEliece  et  al., 
1998;Murphy  et  al.,  1999],  and  non-probabilistic  knowledge  acquisition  interface,  termed  as  the 
CAST  logic  [Chang  et  al.,  1994;Rosen  and  Smith,  1996]. 

The  modeling  of  the  causal  relationships  using  an  IN  is  accomplished  by  connecting  a  set 
of  actionable  events  and  a  set  of  desired  effects  through  chains  of  cause  and  effect  relationships. 
The  strength  of  such  relationships  is  specified  using  the  CAST  logic  parameters  (a  brief  overview 
of  the  logic  is  presented  later  in  this  section)  instead  of  the  probabilities.  The  required 
probabilities  are  internally  generated  by  the  CAST  logic  with  the  help  of  user-defined  parameters. 
The  Influence  Nets  are  therefore  appropriate  for  the  following  situations:  i)  for  modeling 
situations  in  which  it  is  difficult  to  fully  specify  all  conditional  probability  values  ii)  and/or  the 
estimates  of  conditional  probabilities  are  subjective,  and  iii)  estimates  for  the  conditional 
probabilities  cannot  be  obtained  from  empirical  data,  e.g.,  when  modeling  potential  human 
reactions  and  beliefs. 

The  actionable  events  in  an  IN  are  drawn  as  root  nodes  (nodes  without  incoming  edges). 
A  desired  effect,  or  an  objective  the  decision  maker  is  interested  in,  is  modeled  as  a  leaf  node 
(node  without  outgoing  edges).  Typically,  the  root  nodes  are  drawn  as  rectangles,  while  the  non¬ 
root  nodes  are  drawn  as  rounded  rectangles.  Consider  the  IN  of  Figure  1.  The  text  associated  with 


the  non-root  nodes  represents  the  corresponding  conditional  probability  values  obtained  from  the 
CAST  logic  parameters  (not  shown  in  the  figure)  while  the  text  associated  with  the  root  nodes 
represents  the  prior  probabilities.  The  texts  associated  with  arcs  are  time  delays  and  are  explained 
in  Section  3.  The  belief  propagation  scheme  used  in  INs  is  based  on  independence  of  parents 
assumptions.  Thus,  the  marginal  probability  of  a  non-root  node  is  computed  with  the  help  of  its 
Conditional  Probability  Table  (CPT)  and  the  prior  probabilities  of  its  parents.  For  instance,  the 
marginal  probability  of  variable  A  is  computed  as 

P(A)  =  P(A  |  -nB,  ^E)P(^B)P(^E)  +  P(A  \  -nB,  E)P(^B)P(E)  +  P(A  \  B,  -nE)P(B)P(^E) 

+  P(A  |  B,  E)P(B)P(E) 

=  0.005 x  0.95 x  0.99  +  0.95 x  0.95 x  0.01  +  0.95 x  0.05 x  0.99  +  0.99 x  0.05  x  0.01 
=  0.06 

The  probability  of  D  is  then  computed  by  using  its  CPT  and  the  marginal  probabilities  of  A 
(computed  above)  and  E.  Thus 

P(D)  =  P(D  |  -E,  -A)P(^E)P(^A)  +  P(D  \  -,E,  A)P(^E)P(A)  +  P(D  \  E,  -A)P(E)P(^A) 

+  P(D  |  E,  A)P(E)P(A) 

=  0.05x0.99x0.94  +  0.95x0.99x0.06  +  0.001  x  0.01  x  0.94  +  0.05x0.01  x  0.06 
=  0.11 


P(E)  -  0,01 


P(D|— iE,— iA)  =  0.050 
P(D|-iE,  A)  =  0.950 
P(D|  E,-,A)  =  0.001 
P(D|  E,  A)  =  0.050 


Figure  1:  A  Sample  Influence  Net 

Formally,  Influence  Nets  are  Directed  Acyclic  Graphs  (DAGs)  where  nodes  in  the  graph 
represent  random  variables,  while  the  edges  between  pairs  of  variables  represent  causal 
relationships.  The  following  items  characterize  an  IN: 

1 .  A  set  of  random  variables  that  makes  up  the  nodes  of  an  IN.  All  the  variables  in  the  IN 
have  binary  states. 

2.  A  set  of  directed  links  that  connect  pairs  of  nodes. 

3.  Each  link  has  associated  with  it  a  pair  of  CAST  Logic  parameters  that  shows  the  causal 
strength  of  the  link  (usually  denoted  as  g  and  h  values). 

4.  Each  non-root  node  has  an  associated  CAST  Logic  parameter  (denoted  as  the  baseline 
probability),  while  a  prior  probability  is  associated  with  each  root  node. 


1 

P(B)  =  0.05 
I  I  5  \ 

B  - •-  A  - ►  D 

-  I _ )  ' - 

P(A|— iE,— iB)  =  0.005 
P(A|-,E,  B)  =  0.950 
P(A|  E,-,B)  =  0.950 
P(A|  E,  B)  =  0.990 


Definition  1 

An  Influence  Net  is  a  tuple  (V,  E,  C,  B)  where 
V:  set  of  Nodes, 

E:  set  of  Edges, 

C  represents  causal  strengths: 

E  { (h,  g)  such  that  -1  <  h,  g  <  1  }, 

B  represents  a  Baseline  or  Prior  probability: 

V  ^  [0,1] 

2.1  CAST  Logic 

Chang  et  al.  [Chang  et  al.,  1994]  developed  a  formalism,  at  George  Mason  University,  called 
CAusal  STrength  (CAST)  logic  as  an  intuitive  and  approximate  language  to  elicit  the  large 
number  of  conditional  probabilities  from  a  small  set  of  user-defined  parameters.  The  logic  has  its 
roots  in  Noisy-OR  approach  [Agosta,  1991;Drudzel  and  Henrion,  1993].  In  fact,  it  can  be  shown 
that  the  Noisy-OR  approach  is  a  special  case  of  the  CAST  logic.  The  logic  requires  only  a  pair  of 
parameter  values  for  each  dependency  relationship  between  any  two  random  variables.  The  logic 
is  briefly  explained  with  the  help  of  an  example  shown  in  Figure  2.  Readers  interested  in  a 
detailed  description  of  the  CAST  logic  should  refer  to  [Chang  et  al.,  1994;Rosen  and  Smith, 
1996], 


Figure  2:  An  Influence  Network  with  CAST  Logic  Parameters 


Figure  2  contains  four  nodes  A,  B,  C  and  X.  On  each  arc,  two  causal  strengths  are 
specified.  These  numbers  represent  the  probability  that  a  specified  state  of  a  parent  node  will 
cause  a  certain  state  in  the  child  node.  Positive  values  on  arcs  are  causal  influences  that  cause  a 
node  to  occur  with  some  probability,  while  negative  values  are  influences  that  cause  the  negation 
of  a  node  to  occur  with  some  probability.  For  instance,  the  arc  between  B  and  X  has  values  -0.4 
and  0.8.  The  first  value,  referred  to  as  h,  states  that  if  B  is  true,  then  this  will  cause  X  to  be  false 
with  probability  0.4,  while  the  second  value,  referred  to  as  g,  states  that  if  B  is  false,  then  this  will 
cause  X  to  be  true  with  probability  0.8.  Both  h  and  g  can  take  values  in  the  interval  (-1,  1).  All 
non-root  nodes  are  assigned  a  baseline  probability,  which  is  similar  to  the  “leak”  probability  in 
the  Noisy-OR  approach.  This  probability  is  the  user-assigned  assessment  that  the  event  would 
occur  independently  of  the  modeled  influences  in  a  net. 


There  are  four  major  steps  in  the  CAST  logic  algorithm  that  converts  the  user-defined 
parameters  into  conditional  probabilities: 

a)  Aggregate  positive  causal  strengths 

b)  Aggregate  negative  causal  strengths 

c)  Combine  the  positive  and  negative  causal  strengths,  and 

d)  Derive  conditional  probabilities 

In  Figure  2,  there  are  eight  conditional  probabilities  that  need  to  be  computed  to  obtain  the 
marginal  probability  of  X.  The  marginal  probability  of  X  is  computed  as: 

P(X)=P(X  |  - A ,  - B ,  - C)P  XA,  - B ,  -Q  +  P(X\  -X,  - B ,  C)  P  (~-A,  - B ,  C) 

+  P  (X  |  - A,  B,  -Q  P  (=A,  B,  =C)  +  P  (X  |  -X,  B,  C)  P  (=A,  B,  C) 

+  P  (X\  A,  - B ,  -Q  P  (A,  - B ,  -Q  +  P  (X  |  4  -5,  C)  P  (^A,  - 5 ,  C) 

+  P(X\A,B,^C)P(A,B,^C)  +  P(X\A,B,  C)  P  (A,  B,  C)  (1) 

The  four  steps,  described  above,  are  used  to  calculate  each  of  these  eight  conditional 
probabilities.  For  instance,  to  calculate  the  probability  P  (X  \  A,  B,  ~^C),  the  h  values  on  the  arcs 
connecting  A  and  B  to  X  and  the  g  value  on  the  arc  connecting  C  to  X  are  considered.  Hence,  the 
set  of  causal  strengths  is  {0.9,  -0.4,  -0.5}. 

Aggregate  the  Positive  Causal  Strengths:  In  this  step,  the  set  of  causal  strengths  with  positive 
influence  are  combined.  They  are  aggregated  using  the  equation 

P/  =  l-n(1-c’;)  VC,.  >0 

i 

where  C,  is  the  corresponding  g  or  h  value  having  positive  influence  and  PI  is  the  combined 
positive  causal  strength.  For  our  example 

PI=  1 -(1-0.9)  =  0.9 


Aggregate  the  Negative  Causal  Strengths:  In  this  step,  the  causal  strengths  with  negative  values 
are  combined.  The  equation  used  for  aggregation  is 


NI  =  1-  no  -C;)  VC,.  <0 

i 


where  C;  is  the  corresponding  g  or  h  value  having  negative  influence  and  NI  is  the  combined 
negative  causal  strength.  Using  the  above  equation,  the  aggregate  negative  influence  is  found  to 
be: 

NI  =  1  -  (1  -  0.4)  (1  -  0.5)  =0.7 


Combine  Positive  and  Negative  Causal  Strengths:  In  this  step,  aggregated  positive  and  negative 
influences  are  combined  to  obtain  an  overall  net  influence.  The  difference  of  these  aggregated 
influences  is  taken.  The  overall  influence  is  obtained  by  taking  the  ratio  of  this  difference  and  the 
corresponding  promoting  or  inhibiting  influence.  Mathematically, 

If  PI  >  NI 


AI  = 


PI-NI 
1  -NI 


IfNI  >  PI 


AI  = 


NI-PI 


l-PI 


Thus,  the  overall  influence  for  the  current  example  is 

AI  =(0.9-  0. 7)/ (1-0.7)  =  .  66 

Derive  Conditional  Probabilities:  In  the  final  step,  the  overall  influence  is  used  to  compute  the 
conditional  probability  value  of  a  child  for  the  given  combination  of  parents. 

P (child  |  jth  state  of  parent  states)  =  baseline  +  (1  -  baseline)  x  AI  when  PI  >  NI 

=  baseline  -  baseline  x  AI  when  PI  <  NI 

Using  the  above  equation,  P  (X  \  A,  B,  =C)  is  obtained  as: 

P  (X |  A,  B,  -Q  =  0.5  +  0.5  *  0.66  =  .863 

The  steps  explained  above  are  repeated  for  the  remaining  seven  conditional  probabilities  in 
Equation  1.  If  the  experts  had  sufficient  time  and  knowledge  of  the  influences,  then  the 
probability  matrix  for  each  node  can  be  used  instead  of  g  and  h  values.  Also,  after  estimating  the 
conditional  probability  matrix,  if  some  entries  do  not  satisfy  the  expert,  then  those  entries  can  be 
modified  and  then  used  for  computing  the  marginal  probability  of  a  node. 

3  Timed  Influence  Nets 

Influence  Nets  are  designed  to  capture  static  interdependencies  among  variables  in  a  system. 
However,  a  situation  where  the  impact  of  a  variable  takes  some  time  to  reach  the  affected 
variable(s)  cannot  be  modeled  by  either  of  the  two  approaches.  Wagenhals  et  al.  [1998]  have 
added  a  special  set  of  temporal  constructs  to  the  basic  formalism  of  Influence  Nets.  The  Influence 
Nets  with  these  additional  temporal  constructs  are  called  Timed  Influence  Nets  (TINs)  [Haider 
and  Levis,  2004;Haider  and  Zaidi,  2004],  The  temporal  constructs  allow  a  system  modeler  to 
specify  delays  associated  with  nodes  and  arcs.  These  delays  may  represent  the  information 
processing  and  communication  delays  present  in  a  given  situation.  For  example,  in  Figure  1,  the 
inscription  associated  with  each  arc  shows  the  corresponding  time  delay  it  takes  for  a  parent  node 
to  influence  a  child  node.  For  instance,  event  B  influences  the  occurrence  of  event  A  in  5  time 
units. 


(a)  B  at  time  1  and  E  at  time  6 


Figure  3:  Probability  Profiles  of  Event  D 

TINs  have  been  experimentally  used  in  the  area  of  Effects  Based  Operations  (EBOs)  for 
evaluating  alternate  courses  of  actions  and  their  effectiveness  to  mission  objectives.  [Wagenhals 


and  Levis,  2000;  Wagenhals  and  Levis,  2001;  Wagenhals  et  al.,  2003]  The  purpose  of  building  a 
TIN  is  to  evaluate  and  compare  the  performance  of  alternative  courses  of  action.  The  impact  of  a 
selected  course  of  action  on  the  desired  effect  is  analyzed  with  the  help  of  a  probability  profile. 
Consider  the  net  shown  in  Figure  1 .  Suppose  it  is  decided  that  actions  B  and  E  are  taken  at  time  1 
and  7,  respectively.  Because  of  the  propagation  delay  associated  with  each  arc,  the  influences  of 
these  actions  impact  event  D  over  a  period  of  time.  As  a  result,  the  probability  of  D  changes  at  a 
different  time  instants.  A  probability  profile  draws  these  probabilities  against  the  corresponding 
time  line.  The  probability  profile  of  event  D  is  shown  in  Figure  3. 

The  following  items  characterize  a  TIN: 

1 .  A  set  of  random  variables  that  makes  up  the  nodes  of  a  TIN.  All  the  variables  in  the  TIN 
have  binary  states. 

2.  A  set  of  directed  links  that  connect  pairs  of  nodes. 

3.  Each  link  has  associated  with  it  a  pair  of  parameters  that  shows  the  causal  strength  of  the 
link  (usually  denoted  as  g  and  h  values). 

4.  Each  non-root  node  has  an  associated  baseline  probability,  while  a  prior  probability  is 
associated  with  each  root  node. 

5.  Each  link  has  a  corresponding  delay  d  (where  d  >  0)  that  represents  the  communication 
delay. 

6.  Each  node  has  a  corresponding  delay  e  (where  e  >  0)  that  represents  the  information 
processing  delay. 

7.  A  pair  (p,  t)  for  each  root  node,  where  p  is  a  list  of  real  numbers  representing  probability 
values.  For  each  probability  value,  a  corresponding  time  interval  is  defined  in  t.  In 
general,  (p,  t)  is  defined  as 

([Pb  Pn],  [[til,  ti2],  [t21,  t22],  ••••,  [tnl,  W]]  ), 

where  t,i  <  t,2  and  ty  >  0  V  i  =  1,  2,  ....,  n  and  j  =  1,2 
The  last  item  in  the  above  list  is  referred  to  as  an  input  scenario,  or  sometimes  (informally)  as  a 
course  of  action.  Formally,  a  TIN  is  described  by  the  following  definition. 

Definition  2  Timed  Influence  Net  (TIN) 

A  TIN  is  a  tuple  (V,  E,  C,  B,  De,  Dy,  A)  where 
V:  set  of  Nodes, 

E:  set  of  Edges, 

C  represents  causal  strengths: 

E  { (h,  g)  such  that  -1  <  h,  g  <  1  }, 

B  represents  Baseline  /  Prior  probability:  V  ->  [0,1], 

De  represents  Delays  on  Edges:  E  ->  Z+,  (where  Z+  represent  the  set  of  positive  integers) 

Dv  represents  Delays  on  Nodes:  V  Z+,  and 

A  (input  scenario)  represents  the  probabilities  associated  with  the  state  of  actions  and  the  time 
associated  with  them. 

A:  {([pi,p2,...,pn]  ,[[tll,tl2],  [t21,t22],  ••••,[tnl,tn2]]  ) 

such  that  p;  =  [0,  1],  ty  ->  Z  and  tu  <  t^,  V  i  =  1,  2,  . . ..,  n  and  j  =  1,2  where  RcV) 

(where  Z  represent  the  set  of  nonzero  positive  integers) 


4.  Limitations  of  TIN  and  the  Proposed  Enhancements 
4.1  Modeling  of  Memory 

The  existing  TINs  are  not  capable  of  modeling  the  impact  of  different  sequences  of  actions  on  the 
desired  effect.  This  behavior  is  because  of  the  underlying  assumption  in  TINs  that  events  are 
memoryless,  i.e.  the  probability  of  occurrence  of  an  event  at  a  particular  time  instant  does  not 
depend  upon  its  own  probabilities  of  occurrence  during  the  previous  time  instants.  As  a 
consequence,  the  probability  of  an  event  depends  only  upon  the  actions  executed  so  far  and  not 
on  the  sequence  in  which  these  actions  are  executed.  The  proposed  approach  adds  an  optional 
self-loop  to  each  node.  The  events  having  self-loops  are  no  longer  assumed  to  be  memoryless. 
Like  other  arcs  in  a  TIN,  a  self-loop  is  also  specified  using  the  CAST  logic.  A  higher  value 
(either  positive  or  negative)  of  the  parameters  imitates  strong  memory  while  a  lower  value 
imitates  weak  memory.  If  both  parameters  (h  and  g)  are  set  to  zero  then  this  is  equivalent  of 
having  no  self-loop.  Thus,  this  class  of  TINs  is  a  superset  of  the  TINs  that  were  defined  in 
Definition  2.  In  the  TIN  of  Figure  1,  if  events  A  and  D  depend  upon  their  previous  states,  then 
this  phenomenon  is  captured  by  adding  a  self-loop  to  each  of  them  as  shown  in  Figure  4. 


Figure  4:  A  Timed  Influence  Net  with  Self-loop 


Figure  5:  A  TIN  having  3  Nodes 


The  addition  of  self-loop  not  only  changes  the  final  probability  of  the  variable  of  interest, 
but  it  also  has  an  affect  on  the  trajectory  of  the  probability  profile.  Consider  the  TIN  shown  in 
Figure  5.  It  has  three  variables  A,  B,  and  C.  In  the  absence  of  a  self-loop,  the  probability  of  event 
C  depends  only  upon  the  probability  of  its  parents,  that  is,  A  and  B.  Suppose  two  courses  of 
action  required  to  be  evaluated  for  this  model.  In  the  first  course  of  action  (COA  1),  actions  A 
and  B  are  taken  at  times  10  and  12,  respectively  while  in  the  second  course  of  action  2  (COA  2), 


A  and  B  are  taken  at  time  12  and  10,  respectively.  The  respective  probability  profdes  of  C  as  a 
result  of  these  courses  of  action  are  shown  in  Figure  6(a)  and  6(b).  Despite  the  fact  that  the 
trajectories  shown  in  the  two  profiles  differ  significantly,  the  final  probability  of  event  C  is  same 
(0.85)  in  both  profiles.  This  behavior  is  due  to  the  fact  that  the  underlying  TIN  model  is 
memoryless.  Thus,  no  matter  what  the  sequence  of  actions  A  and  B  is,  the  likelihood  of 
occurrence  of  C  is  same  once  both  actions  are  taken. 


JSJxJ 


(a)  COA  1  (b)  COA  2 

Figure  6:  Probability  Profiles  of  Event  C  in  the  TIN  of  Figure  5 


In  contrast  to  the  given  situation,  suppose  the  likelihood  of  C  at  a  particular  time  instance 
depends  upon  its  own  likelihood  in  the  past.  The  proposed  methodology  attempts  to  model  this 
situation  by  adding  a  self-loop  to  event  C.  The  modified  TIN  is  shown  in  Figure  7.  The  text 
associated  with  the  self-loop  shows  the  corresponding  CAST  logic  parameters.  In  addition  to 
their  normal  semantics,  the  parameters  attached  to  a  self-loop  also  represent  the  strength  of  the 
memory  associated  with  the  corresponding  variable.  For  instance,  high  values  of  g  and  h  strongly 
causes  a  node  to  remain  in  its  previous  state,  while  a  lower  values  of  g  and  h  represents  a  weak 
memory  and  thus  the  previous  state  of  a  variable  does  not  have  a  large  influence  on  its  current 
state.  The  two  courses  of  action  described  earlier  (COA  1  and  COA  2)  are  executed  for  the  model 
of  Figure  7(a)  and  the  respective  profiles  are  shown  in  Figure  8. 


(a)  Strong  Memory  (b)  Weak  Memory 

Figure  7:  Different  Levels  of  Memory  Modeled  Using  Self-Loops 
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Figure  8:  Probability  Profiles  of  Event  C  in  the  TIN  of  Figure  7(a) 


It  can  be  seen  from  the  profiles  that  the  final  probability  of  event  C  is  different  in  the  two 
profiles.  This  change  in  the  behavior  of  the  TIN  occurs  because  of  the  fact  that  now  the  present 
likelihood  of  C  depends  upon  its  likelihood  in  the  past  along  with  the  probabilities  of  its  parents. 
For  instance,  in  the  profile  of  Figure  8(a),  event  A  happens  first  which  causes  an  increase  in  the 
probability  of  C  (0.85)  as  the  occurrence  of  A  has  a  strong  positive  influence  on  the  occurrence  of 
C.  B  happens  after  A.  Despite  its  negative  influence,  B  fails  to  decrease  the  likelihood  of  C  as  C 
has  a  strong  memory  that  causes  it  to  remain  in  the  previous  state  along  with  the  fact  that  a  strong 
positive  influence  from  A  counterbalances  a  moderate  negative  influence  from  B.  Thus,  the  final 
probability  of  C  is  0.87.  In  the  second  profile  (Figure  8(b)),  B  happens  first  and  due  to  its 
negative  influence  on  C  the  probability  of  C  is  decreased  to  0.56.  A  happens  next  and  it  slightly 
increases  the  probability  of  C  to  0.63  but  not  as  much  as  it  is  increased  in  COA  1  because  of  the 
dependency  of  C  on  its  previous  state.  While  computing  the  profiles  of  Figures  6  and  8,  it  can  be 
noticed  that  the  profiles  have  quite  a  different  behavior  in  both  courses  of  action. 

As  mentioned  earlier,  if  the  h  and  g  values  associated  with  a  self-loop  are  low,  then  the 
loop  represents  a  weak  influence  of  the  previous  state  of  a  node  on  its  current  state.  Suppose  in 
the  model  of  Figure  7(a),  the  g  and  h  values  associated  with  the  self-loop  are  revised  and  are  as 
shown  in  Figure  7(b).  The  same  two  courses  of  action  (COA  1  and  COA  2)  are  executed  in  this 
situation  and  the  resultant  probability  profiles  are  shown  in  Figure  9:  a  weak  memory  has  resulted 
in  the  final  probabilities  very  close  to  what  is  obtained  in  the  profiles  based  on  a  memoryless  TIN 
(Figure  6). 

Up  until  now,  it  is  assumed  that  a  node’s  likelihood  at  a  previous  time  stamp  is  used  to 
update  its  current  likelihood  when  a  new  piece  of  information  arrives  from  one  of  its  parents.  A 
self-loop  can  also  be  used  to  update  the  probability  of  a  node  at  a  regular  time  interval.  This  time 
interval  is  specified  as  the  delay  associated  with  a  self-loop.  Thus  a  self-loop  can  be  used  to 
model  decay  in  the  belief  of  a  node  as  the  time  passes  and  no  new  information  from  its  parents 
influences  it.  Suppose  in  the  model  of  Figure  7,  the  self-loop  associated  with  node  C  has  a  delay 
of  1  time  unit  which  means  that  the  probability  of  C  is  updated  after  every  1  time  unit  regardless 
of  whether  there  is  new  information  coming  from  its  parents  or  not.  In  the  sequel,  if  the  delay 
associated  with  a  self-loop  has  a  value  of  zero  then  it  means  that  a  previous  value  of  a  node  is 


used  to  update  its  current  likelihood  only  when  there  is  new  information  coming  from  its  parents. 
Positive  values  other  than  zero  indicate  that  the  update  would  occur  at  a  regular  time  interval. 
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Figure  9:  Probability  Profiles  of  Event  C  in  the  TIN  of  Figure  7(b) 


4.2  Modeling  of  Time  Varying  Influences 

Events  happen  and  they  influence  other  relevant  events.  In  many  cases,  the  intensity  of  their 
influences  decays  over  time.  Thus,  an  event  having  a  very  strong  influence  at  the  time  of  its 
occurrence  on  another  event  might  have  an  insignificant  influence  after  a  certain  period  of  time. 
In  other  words,  the  influence  of  an  event  is  time-variant.  The  time-varying  property  also  holds 
true  for  the  state  of  an  action.  An  action  may  occur  in  two  different  states  during  two  different 
time  intervals.  In  TINs  terminology,  these  two  types  of  time- varying  properties  are  referred  to  as 
persistence.  The  one  related  to  the  time  dependent  influence  of  an  action  is  called  persistence  of 
influence,  while  the  one  related  to  the  time-dependent  state  of  an  action  is  called  persistence  of 
action.  Among  these  two  types  of  persistence,  a  TIN  currently  models  the  latter  one  only.  It 
assumes  that  the  causal  strength  of  the  influences  does  not  change  over  time,  i.e.,  the  underlying 
stochastic  model  is  stationary.  Thus,  it  lacks  the  ability  to  model  persistence  of  influence.  This 
paper  attempts  to  overcome  this  limitation  of  TINs.  The  proposed  approach  enables  a  system 
modeler  to  model  non-stationary  influences.  Instead  of  asking  a  modeler  to  specify  single-  valued 
influences,  the  proposed  approach  would  allow  the  modeler  to  specify  various  strengths  of 
influences  and  their  corresponding  window  of  effectiveness. 


Figure  10:  A  TIN  Having  Time-Variant  Influences 


Consider  the  TIN  of  Figure  10.  The  prior  probability  of  nodes  A  and  B  at  time  0  is  0.05 
and  0.1,  respectively.  Action  A  is  taken  at  time  4  while  the  probability  of  occurrence  of  B 
becomes  0.6  at  time  7  and  1  at  time  10.  The  CAST  logic  parameters  associated  with  the  arc  are 
time-varying  and  are  read  in  the  following  manner.  A  has  a  high  positive  influence  on  C,  if  the 
change  occurred  at  A  is  2  to  3  time  units  old,  and  its  influence  is  moderate,  if  the  change  occurred 
at  A  is  4  to  5  time  units,  while  its  influence  is  low  if  the  change  occurred  at  A  is  more  than  6  time 
units  old.  For  simplicity  “high  influence”  is  assumed  to  mean  that  both  h  and  g  have  the  same 
values  though  with  opposite  signs  (one  is  positive  and  the  other  is  negative).  Similarly,  B  has  a 
strong  negative  influence  on  C  when  the  change  that  occurred  at  B  is  1  to  2  time  units  old,  while 
it  has  a  low  influence  when  the  change  occurred  at  B  is  more  than  2  time  units  old.  Due  to  the 
provided  input  scenario,  the  probability  of  C  is  updated  at  time  6,  8,  and  1 1  as  the  time  delays 
between  A  and  C  and  B  and  C  are  2  and  1,  respectively.  C  is  updated  at  time  6  because  action  A 
is  taken  at  time  stamp  4.  The  last  change  that  occurred  at  B  is  at  time  0.  Thus,  the  probability  of  B 
used  in  computing  the  marginal  probability  of  C  is  0. 1 .  Since  this  value  is  6  time  units  old,  while 
computing  the  CPT  values  for  node  C  a  low  negative  influence  of  B  on  C  is  considered.  The  TIN 
with  a  particular  instance  of  the  CAST  logic  parameters  along  with  the  prior  probabilities  is 
shown  in  Figure  11.  The  Conditional  Probability  Table  (CPT)  values  computed  under  this 
situation  are  also  shown  beside  node  C.  Based  on  the  parameters  shown  in  the  figure,  the 
marginal  probability  of  C  at  time  6  is  computed  as  given  below. 

P(C)  =  P(C\  -A,  -nB)  x  P(—A)  x  P(—iB)  +  P(C\  -A,  B)  x  P(A)  x  P(B) 

+  P(C\-A,  B)xP(-A)xP(  B)  +  P(C\  A,  B)xP(A)xP(B) 

=  0.07 x  0  x  0.9  +  0.03  x  0  x  0.9  +  0.97 x  1  x  0.1  +  0.93  x  1  x  0.9 
=  0.93 


P(A)=1 


P(C|— iA,-iB)  =  0.07 
P(C|— iA,  B)  =  0.03 
P(C|  A,  B)  =  0.97 
P(C|  A,  B)  =  0.93 


Figure  11:  An  Instance  of  the  TIN  of  Figure  10 

The  next  update  of  P(C)  occurs  at  time  8.  At  this  time  instance,  the  marginal  probability 
of  A  is  4  time  units  old;  thus  a  moderate  positive  influence  of  A  on  C  is  considered  while 
computing  the  CPT  values.  The  probability  of  B  is  only  2  time  units  old  and  has  a  strong  negative 
influence  on  C.  The  resultant  parameters,  along  with  the  CPT  values,  are  shown  in  Figure  12.  The 
probability  of  C  at  time  8  is  computed  as  shown  below. 

P(C)  =  P(C\  -A,  -iB)  x  P(—A)  x  P(-iB)  +  P(C\  -A,  B)  x  P(A)  x  P(B) 

+  P(C\—A,  B)xP(—A)xP(  B)  +  P(C\  A,  B)xP(A)xP(B) 

=  0.85  x  0  x  0.4  +  0.02 x  Ox  0.6  +  0.98 x  1  x  0.4  +  0.15  x  1  x  0.6 
=  0.48 


P(A)  =  1 


P(C|— iA,— iB)  =  0.85 
P(C|— iA,  B)  =  0.02 
P(C|  A,  B)  =  0.98 
P(C|  A,  B)  =  0.15 


Figure  12:  Another  Instance  of  the  TIN  of  Figure  10 


The  last  update  of  P(C)  occurs  at  time  11.  The  marginal  probability  of  A  is  7  time  units  old,  while 
B’s  is  2  time  units  old.  Thus,  a  low  positive  influence  from  A  and  a  strong  negative  influence 
from  B  are  considered.  The  updated  probability  of  C  is  found  to  be  0.07.  The  above  analysis 
demonstrated  how  non-stationary  CAST  logic  parameters  have  resulted  in  non-stationary  CPT 
values  that  are  used  in  computing  the  probability  of  C  at  various  time  stamps.  Thus,  despite  the 
fact  that  an  action  is  still  in  effect,  it  may  loose  its  significance  as  time  passes  by.  The  non- 
stationary  CPT  values  used  in  the  above  computations  are  compared  in  Table  1  along  with  the 
time  of  their  computation. 


Tablel:  for  Non-Stationary  CPTs 


Time 

Parents  Combination 

6 

8 

11 

P(C|— iA,— iB) 

0.07 

0.85 

0.93 

P(C|— iA,  B) 

0.03 

0.02 

0.03 

P(C|  A,— iB) 

0.97 

0.98 

0.97 

P(C|  A,  B) 

0.93 

0.15 

0.07 

5.  DYNAMIC  INFLUENCE  NETS 

The  incorporation  of  the  proposed  structural  and  parametric  changes  in  TINs,  as  described  in  the 
previous  sections,  would  enable  a  system  modeler  to  observe  the  impact  of  repeated  actions.  For 
instance,  an  air-strike  on  a  bridge  makes  it  inoperable  for  several  days.  The  current 
implementation  of  TINs  would  assume  that  the  influence  of  the  air-strike  remains  the  same 
throughout  the  campaign.  It  is  obvious  that  the  assumption  is  unrealistic.  Furthermore,  in  the 
event  of  a  new  air-strike,  a  TIN  would  discard  the  impact  of  the  previous  air-strike  as  the  events 
in  a  TIN  are  assumed  to  be  memory-less.  The  proposed  approach,  which  allows  time-varying 
influences  and  incorporation  of  memory  through  self-loops,  models  this  situation  in  a  more 
intuitive  manner.  Like  other  arcs  in  a  TIN,  a  self-loop  also  represents  influence  -  from  the 
previous  state  of  a  node  to  its  current  state.  Thus,  time-varying  parameters  can  be  associated  with 
a  self- loop  too.  For  the  air-strike  example,  the  presence  of  self-loop  would  combine  the 
influences  of  both  (or  many)  air-strikes  while  the  strength  of  the  self-loop  accounts  for  the  time 
delay  between  the  two  air-strikes.  If  the  timing  of  two  air-strikes  is  far  apart,  then  there  is  almost 
no  influence  of  the  first  strike  on  the  operability  of  the  bridge  (provided  that  the  bridge  has  been 


rebuilt),  but  if  the  two  strikes  occurred  very  close  in  time  then  their  impact  would  be  more 
destructive.  In  other  words  the  impact  of  two  actions  on  the  effect  convolves.  The  issue  is  further 
explained  with  the  help  of  the  following  example.  Suppose  the  variables  in  the  model  of  Figure 
10  have  the  following  descriptions: 

A  -  Regional  Countries  Opposes  Sanctions  against  Country  R 
B  -  Country  G  Threatens  to  Take  Unilateral  Actions  against  Country  R 
C  -  Leader  of  Country  R  Decides  to  Accept  UN  Demands 


Figure  13:  A  TIN  with  Self-Loop  and  Time-Varying  Influences 


jojxl 


(a)  Profile  of  event  C  in  a  DIN  (b)  Profile  of  event  C  in  a  TIN 

Figure  14:  Comparison  of  Profiles  Generated  by  a  TIN  and  a  DIN 


Further  assume  that  the  belief  of  event  C  at  a  particular  time  depends  upon  its  own  belief 
at  a  previous  time  instance  though  not  very  strongly.  This  behavior  is  modeled  by  adding  a  self¬ 
loop  having  a  low  influence  on  event  C.  The  resultant  model  is  shown  in  Figure  13.  The 
probabilities  of  actionable  events  A  and  B  are  changed  at  various  time  stamps,  as  described 
earlier  and  shown  in  the  figure.  The  resultant  probability  profile  of  C  is  shown  in  Figure  14(a).  If 
the  same  situation  is  modeled  using  an  existing  TIN,  that  is,  without  the  self-loop  and  time- 
invariants  CAST  logic  parameters,  then  the  resultant  profile  of  C  is  as  shown  in  Figure  14(b). 


Currently,  there  is  no  validation  technique  that  helps  us  in  identifying  which  profile  is  a  better 
representation  of  the  situation  at  hand,  but  it  can  be  said  that  the  profile  shown  in  Figure  14(a)  is 
more  in  agreement  with  intuition  than  the  profile  of  Figure  14(b).  The  impact  of  B  is  more 
dominating  in  the  profile  of  Figure  14(a)  as  event  A  happened  6  time  units  earlier  and  has  lost  its 
significance.  Furthermore,  the  previous  state  of  event  C  also  has  an  impact  on  its  current  state. 
Thus,  a  different  sequence  of  actions  would  have  resulted  in  a  completely  different  outcome. 
Profile  of  Figure  14(b)  fails  to  capture  these  characteristics. 

The  incorporation  of  the  new  constructs  (self-loop  and  time-varying  parameters)  in  the 
framework  of  TIN  based  modeling  and  reasoning  enhances  the  capabilities  of  this  modeling 
paradigm  in  terms  of  capturing  dynamic  uncertain  scenarios.  A  TIN  with  these  additional 
constructs  has  been  defined  as  a  Dynamic  Influence  Net  (DIN).  The  following  items  characterize 
a  DIN  while  a  formal  definition  is  given  in  Definition  3. 

1 .  The  nodes  of  a  DIN  are  set  of  random  variables.  All  the  variables  in  the  DIN  have  binary 
states. 

2.  A  set  of  directed  links  that  connect  pairs  of  nodes.  A  node  can  also  have  an  optional  self¬ 
loop. 

3.  A  pair  (c,  t)  for  each  link,  where  c  is  a  list  of  tuples  representing  the  CAST  logic 
parameters.  For  each  element  in  c,  a  corresponding  time  interval  is  defined  in  t.  This 
interval  represents  the  time  during  which  the  corresponding  element  in  c  is  in  effect.  In 
general,  (c,  t)  is  defined  as 

([(hi,  gl)  (h2,  g2), . ,  (hn,  gn)],  [(til,  ti2),  (t21,  t22),  ••••,  (tnl,  W)] 

where  tn  <  tn  and  t;j  >  0  V  i  =  1,2,  . . ..,  n  and  j  =  1,2 

4.  Each  non-root  node  has  an  associated  baseline  probability,  while  a  prior  probability  is 
associated  with  each  root  node. 

5.  Each  link  has  a  corresponding  delay  d  (where  d  >  0)  that  represents  the  communication 
delay. 

6.  Each  node  has  a  corresponding  delay  e  (where  e  >  0)  that  represents  the  information 
processing  delay. 

7.  A  pair  (p,  t)  for  each  root  node,  where  p  is  a  list  of  real  numbers  representing  probability 
values.  For  each  probability  value,  a  corresponding  time  interval  is  defined  in  t.  In 
general,  (p,  t)  is  defined  as 

([Pi,  P2, •  •  • ,  Pn],  [[til,  tl 2] ,  [t-2 1 ,  t22],  [tnl,  W]] 
where  tn  <  t^  and  t;j  >  0  V  i  =  1,2,  . . ..,  n  and  j  =  1,2 


Definition  3 

A  Dynamic  Influence  Net  is  a  tuple  (V,  E,  C,  B,  De,  Dy,  A)  where 
V:  set  of  Nodes, 

E:  set  of  Edges, 

C  represents  causal  strengths: 

E  {([(hi,  gl)  (ll2,  g2), . ,  (hn,  gn)],  [(til,  tl2),  (t21,  t22),  ••••,  (tnl,  C2)]) 

suchthat  -1  <  hi,  gi  <  1  },  ty  ->  Z+  and  tn  <  t;2,  V  i  =  1,  2,  ....,  n  and  j  =  1,  2  } 

B  represents  Baseline  /  Prior  probability:  V  ->  [0,1], 

De  represents  Delays  on  Edges:  E  ->  Z+, 

Dv  represents  Delays  on  Nodes:  V  ->  Z+,  and 

A  (input  scenario)  represents  the  probabilities  associated  with  the  set  of  actions  and  the  time 
associated  with  them. 


A:  R  ->  {([pi,  p2v,  Pn],  [[tn,  ti2],  [hu  t22],  •  •••,  [tni,  W]] ) 

such  that  pi  =  [0,  1],  ty  ->  Z*  and  tn  <  tn,  V  i  =  1,  2,  . . n  and  j  =  1,2  where  RcV} 

Conclusions 

The  paper  presents  structural  and  parametric  enhancements  to  Timed  Influence  Nets  based 
modeling  framework.  Currently,  nodes  in  a  TIN  are  considered  memoryless.  This  inability  results 
in  lack  of  modeling  the  impact  of  different  sequences  of  actions  on  a  desired  effect.  TINs  also  fail 
to  capture  time-varying  influences.  The  proposed  enhancements  would  allow  a  system  modeler  to 
specify  such  influences.  Thus,  the  modeler  would  be  able  to  specify  both  stationary  and  non¬ 
stationary  influences.  Furthermore,  the  dependency  of  an  event  on  its  previous  state  could  also  be 
modeled  by  adding  a  self-loop  to  the  corresponding  node.  The  incorporation  of  self-loop  adds 
memory  to  the  existing  memory-less  TIN.  The  addition  of  both  self-loop  and  time-varying 
influences  would  enable  a  modeler  to  model  impacts  of  repeated  actions  on  an  effect.  Currently, 
in  the  event  of  repeated  actions,  a  TIN  only  considers  the  latest  impact  on  the  effect  while 
ignoring  the  previous  attempts.  The  proposed  DIN  would  convolve  the  impact  of  repeated  actions 
on  the  desired  effect  and,  thus,  further  enhance  the  capabilities  of  TINs  based  modeling 
paradigm. 

References 

Agosta,  J.  M.,  "Conditional  Inter-Causally  Independent  Node  Distributions,  a  Property  of  Noisy- 
or  Models,"  Proceedings  of  7th  Conference  on  Uncertainty  in  Artificial  Intelligence,  1991. 

Chang,  K.  C.,  Lehner,  P.  E.,  Levis,  A.  H.,  Zaidi,  S.  A.  K.  and  Zhao,  X.,  "On  Causal  Influence 
Logic,"  George  Mason  University,  Technical  Report  Dec.  1994. 

Drudzel,  M.  J.  and  Henrion,  M.,  "Intercausal  Reasoning  with  Uninstantiated  Ancestor  Nodes," 
Proceedings  of  the  9th  Conference  on  Uncertainty  in  AI,  1993. 

Haider,  S.  and  Levis,  A.  H.,  "A  Heuristic  Approach  for  Belief  Updating  in  Timed  Influence 
Nets,"  Proceedings  of  2004  Command  and  Control  Research  and  Technology  Symposium,  San 
Deigo,  2004. 

Haider,  S.  and  Zaidi,  A.  K.,  "Transforming  Timed  Influence  Nets  into  Time  Sliced  Bayesian 
Networks,"  Proceedings  of  2004  Command  and  Control  Research  and  Technology  Symposium, 
San  Diego,  2004. 

Kschischang,  F.  R.  and  Frey,  B.  J.,  "Iterative  Decoding  of  Compound  Codes  by  Probability 
Propagation  in  Graphical  Models,"  IEEE  Journal  on  Selected  Areas  in  Communication,  vol.  16, 
pp.  219-230,  1998. 

McEliece,  R.  J.,  MacKay,  D.  J.  and  Cheng,  J.  F.,  "Turbo  Decoding  as  an  Instance  of  Pearl's 
Belief  Propagation  Algorithm,"  IEEE  Journal  on  Selected  Areas  in  Communication,  vol.  16,  pp. 
140-151,  1998. 

Murphy,  K.  P.,  Weiss,  Y.  and  Jordan,  M.  I.,  "Loopy  Belief  Propagation  for  Approximate 
Inference:  An  Empirical  Study,"  Proceedings  of  15th  Conference  on  Uncertainty  in  Artificial 
Intelligence,  1999. 

Pearl,  J.,  Probabilistic  Reasoning  in  Intelligent  Systems:  Network  of  Plausible  Inference:  Morgan 
Kaufmann,  1987. 


Rosen,  J.  A.  and  Smith,  W.  L.,  "Influence  Net  Modeling  with  Causal  Strengths:  An  Evolutionary 
Approach,"  Proceedings  of  the  1996  Command  and  Control  Research  and  Technology 
Symposium,  Monterey  CA,  1996. 

Wagenhals,  L.  W.  and  Levis,  A.  H.,  "  Modeling  Support  of  Effect-Based  Operations  in  War 
Games,"  Proceedings  of  the  2002  Command  and  Control  Research  and  Technology  Symposium, 
2002. 

Wagenhals,  L.  W.,  Levis,  A.  H.  and  McCrabb,  M.  B.,  "Effects-Based  Operations;  a  Historical 
Perspective  of  a  Way  Ahead,"  Proceedings  of  8th  International  Command  and  Control  Research 
and  Technology  Symposium,  2003. 

Wagenhals,  L.  W.  and  Wentz,  L.  K.,  "New  Effects-Based  Operations  Models  in  War  Games," 
Proceedings  of  8th  International  Command  and  Control  Research  and  Technology  Symposium, 
Washington  DC,  2003. 


UNIVERSITY 


Dynamic  Influence  Nets:  An  Extension  of 
Timed  Influence  Nets  for  Modeling 
Dynamic  Uncertain  Situations 

Sajjad  Haider 
Alexander  H.  Levis 


June  14,  2005 

10th  International  CCRTS,  McLean  VA 


6/27/2005 


System  Architectures  Laboratory 


1 


Outline  of  the  Presentation 


UNIVERSITYl 


•  Technical  Background 

-  Influence  Nets 

-  Timed  Influence  Nets 

•  Limitations  of  Timed  Influence  Nets 

-  Different  sequences  of  Actions  have  no  impact  on  the  final 
probability  of  achieving  a  desired  effect 

-  Influences  are  assumed  to  be  time-invariant 

•  Proposed  Methodology 

-  Adding  memory  to  the  nodes  in  a  TIN 

-  Modeling  of  time-varying  influences 

•  Dynamic  Influence  Nets 
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Influence  Nets 


ssa: 


GEORGE 


UNIVERSITYl 


A  set  of  random  variables  that  makes 
up  the  nodes  of  an  IN.  All  the 
variables  in  the  IN  have  binary  states. 

A  set  of  directed  links  that  connect 
pairs  of  nodes. 

Each  link  has  associated  with  it  a 
pair  of  parameters  that  shows  the 
causal  strength  of  the  link  (usually 
denoted  as  h  and  g  values). 


h  is  Influence  of  A  on  B:  Analogous  to  P(B  |  A) 


g  is  Influence  of  -.A  on  B:  Analogous  to  P(B  |  — A) 


Positive  Impact 
•  Negative  Impact 


r 

\ 

V 

y 

Root  Nodes  Non-root  Nodes 
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Probability  Propagation 
in  Influence  Nets 
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0.05 

B 


0.05 


P(A|~B,~E)  =  0.005 
P(A|~B,E)  =0.950 
P(A|B,~E)  =0.950 
P(A|B,E)  =  0.990 


P(D|~E,~A)  =  0.050 
P(D|~E,A)  =0.950 

P(D|E,~A)  =0.001 

P(D|E,A)  =  0.050 


P(A)  =  P(A|~B,~E)P(~B)P(~E)  +  P(A|~B,E)P(~B)P(E)  +  P(A|B  ~E)P(B)P(~E) 

+  P(A|B,E)P(B)P(E) 

=  0.005  x  0.95  x  0.99  +  0.95  x  0.95  x  0.01  +  0.95  x  0.05  x  0.99  +  0.99  x  0.05  x  0.01 
=  0.06 

P(D)  =  P(D|~E,~A)P(~E)P(~A)  +  P(D|~E,A)P(~E)P(A)  +  P(D|E  ,~A)P(E)P(~A) 

+  P(D  |  E,  A)P(E)P(A) 

=  0.05  x  0.99  x  0.94  +  0.95  x  0.99  x  0.06  +  0.001  x  0.01  x  0.94  +  0.05  x  0.01  x  0.06 
=  0.11 
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Specification  of  a 
Timed  Influence  Net 
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The  specification  of  a  TIN  require  the  following  additional  parameters  besides  the 
one  required  for  by  an  ordinary  IN: 

A  time  delay  is  associated  with  each  arc. 

A  time  delay  is  associated  with  each  node. 

Each  actionable  event  is  assigned  time  stamp(s)  at  which  the  decision(s) 
regarding  the  state  of  that  action  is(are)  made 


At  t  =6  At  t  =4 


F 
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Mason  Problem  Statement 

U  N  I  V  E  R  S  I  T 


Given 

□  A  Dynamic  Uncertain  Situation 

□  A  Set  of  Desired  Effects 

□  A  Set  of  Actionable  Events 

-  How  to  capture  certain  dynamic  situations 

•  Modeling  of  time-varying  influences 

-  Strength  of  the  influence  changes  overtime 

-  Influence  vanishes  overtime 

•  Modeling  of  memory  to  help  in  identifying 

-  Impact  of  repetitive  actions  on  the  desired  effects 

-  Impact  of  different  sequence  of  actions  on  the  desired 
effect 
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Time-Varying  Influence 
(Persistence  of  Influence) 

N  I  V  IE  s  I  T 

•  Current  implementation  of  TINs  models  time-invariant  influences 

•  A  scheme  is  proposed  for  modeling  time-varying  influences 

•  A  list  of  influences  along  with  their  time  of  effect  is  specified  for  each 
arc  in  a  TIN 

•  The  proposed  scheme  can  be  used  to  model  time-dependent 
structural  changes  in  a  TIN 


Influence  of  A  on  C  when  information  at  A 

is  t  time  units  old 

Strong:  2  <  t  <  4 

Moderate:  4  <  t  <  6 

Low:  t  >  6 

Influence  of  B  on  C  when  information  at  B 
is  t  time  units  old 
Strong:  1  <  t  <  3 
Low:  t  >  3 
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george  Time-Varying  Influence  (Cont’d) 
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P(A)  =  0.05 
=  1.0 


0 

>4 


P(B)  =  0.1  ( 
=  0.6 


0 

>7 


=  1.0  @  10 


Influence  of  A  on  C  when  information  at  A 

is  t  time  units  old 

Strong:  2  <  t  <  4 

Moderate:  4  <  t  <  6 

Low:  t  >  6 

Influence  of  B  on  C  when  information  at  B 
is  t  time  units  old 
Strong:  1  <  t  <  3 
Low:  t  >  3 


C  is  updated  at  time:  6,  8,  11 

At  time  6:  P(A)  @  4  is  used,  while  P(B)  @  0  is  used 

-  Information  coming  from  A  is  2  time  units  old 

-  Information  coming  from  B  is  6  time  units  old 

•  C  has  strong  influence  of  A  and  low  influence  of  B  at  time  6 
At  time  8:  P(A)  @  4  is  used,  while  P(B)  @  7  is  used 

-  Information  coming  from  A  is  4  time  units  old 

-  Information  coming  from  B  is  1  time  units  old 

•  C  has  moderate  influence  of  A  and  strong  influence  of  B  at  time  8 
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Non-Stationary  Conditional 
Probabilities 
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P(A)  =  0.05  @  0 
=  1.0  @4 


P(B)  =  0.1  @0 
=  0.6  @7 
=  1.0  @  10 


Influence  of  A  on  C  when  information  at  A 

is  t  time  units  old 

Strong:  2  <  t  <  4 

Moderate:  4  <  t  <  6 

Low:  t  >  6 

Influence  of  B  on  C  when  information  at  B 
is  t  time  units  old 
Strong:  1  <  t  <  3 
Low:  t  >  3 


Time 

Parents  Combination 

6 

8 

11 

P(C| — iA, — iB) 

0.07 

0.85 

0.93 

P(C| — iA,  B) 

0.03 

0.02 

0.03 

P(C|  A,-iB) 

0.97 

0.98 

0.97 

P(C|  A,  B) 

0.93 

0.15 

0.07 
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Problem  Statement 
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Given 

□  A  Dynamic  Uncertain  Situation 

□  A  Set  of  Desired  Effects 

□  A  Set  of  Actionable  Events 

-  How  to  capture  certain  dynamic  situations 

•  Modeling  of  time-varying  influences 

-  Strength  of  the  influence  changes  overtime 

-  Influence  vanishes  over  time _ 

•  Modeling  of  memory  to  help  in  identifying 

-  Impact  of  repetitive  actions  on  the  desired  effects 

-  Impact  of  different  sequence  of  actions  on  the  desired  effect 
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Adding  Memory  to  the 
Nodes  in  a  TIN 
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A@  10,  B@  12 


B  @  10,  A  @  12 
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Adding  Memory  to  the  Nodes 
in  a  TIN  (Cont’d) 
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(0.33,  -0.33) 

Weak  Memory 


B@  10,  A@  12 


(0.90,  -0.90) 

Strong  Memory 


*  Probability  Profile  for  C 


^jnj  xj 


~  Probability  Profile  for  C 
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Timed  Influence  Nets  with 

-  Time-varying  influences 

-  Memory  represented  by  a  self-loop 


Probability  Profile  Produced  by  a  DIN 

ansa 
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P(A)  =  0.05  @  0 
=  1.0  @4 


Influence  of  A  on  C  when 
information  at  A  is  t  time  units  old 
Strong:  2  <  t  <  4 
Moderate:  4  <  t  <  6 
Low:  t  >  6 


Probability  Profile  Produced  by  a  TIN 

- 


jgjxj 


P(B)  =  0.1  @0 
=  0.6  @7 
=  1.0  (®  10 


Influence  of  B  on  C  when 
information  at  B  is  t  time  units  old 
Strong:  1  <  t  <  3 
Low:  t  >  3 
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•  Extended  the  knowledge  elicitation  interface  of  TINs  so  that 
they  can  capture  time-varying  cause-effect  relationship 

-  Instead  of  providing  a  single-valued  strength  of  cause-effect 
relationship,  a  system  modeler  can  specify  multi-valued 
strengths  of  cause-effect  relationship  along  with  their  time  of 
effectiveness 

•  Added  a  mechanism  to  incorporate  memory  in  a  TIN  to  capture 
the  impact  of  repetitive  actions  and  different  sequence  of 
actions  on  the  desired  effect 

-  A  self-loop  is  added  to  a  node  that  captures  memory  of  the 
node 

-  The  strength  of  the  self-loop  specify  whether  the  modeled 
memory  is  weak  or  strong 

•  Together  these  two  features  capture  the  impact  of  repetitive 
actions 
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Questions? 
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